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DISCRETE REPRODUCING KERNEL HILBERT SPACES: 
SAMPLING AND DISTRIBUTION OF DIRAC-MASSES 

PALLE JORGENSEN AND FENG TIAN 


Abstract. We study reproducing kernels, and associated reproducing kernel Hilbert 
spaces (RKHSs) ffl" over infinite, discrete and countable sets V. In this setting we 
analyze in detail the distributions of the corresponding Dirac point-masses of V. 
Illustrations include certain models from neural networks: An Extreme Learning 
Machine (ELM) is a neural network-configuration in which a hidden layer of weights 
are randomly sampled, and where the object is then to compute resulting output. 
For RKHSs of functions defined on a prescribed countable infinite discrete set 
V, we characterize those which contain the Dirac masses 5 X for all points x in V. 
Further examples and applications where this question plays an important role are: 
(i) discrete Brownian motion-Hilbert spaces, i.e., discrete versions of the Cameron- 
Martin Hilbert space; (ii) energy-Hilbert spaces corresponding to graph-Laplacians 
where the set V of vertices is then equipped with a resistance metric; and finally 
(iii) the study of Gaussian free fields. 
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1. Introduction 

A reproducing kernel Hilbert space (RKHS) is a Hilbert space of functions on a 
prescribed set, say V, with the property that point-evaluation for functions / £ is 
continuous with respect to the Jrff- norm. They are called kernel spaces, because, for 
every x £ V, the point-evaluation for functions / £ Jtf, f ( x ) must then be given as a 
J^-inner product of / and a vector k x , in called the kernel. 

The RKHSs have been studied extensively since the pioneering papers by Aronszajn 
in the 1940ties, see e.g., [Aro43, Aro48]. They further play an important role in the 
theory of partial differential operators (PDO); for example as Green’s functions of 
second order elliptic PDOs; see e.g., [Nel57, HKL+14], Other applications include 
engineering, physics, machine-learning theory (see [KH11, SZ09, CS02] ), stochastic 
processes (e.g., Gaussian free fields), numerical analysis, and more. See, e.g., [AD93, 
ABDdS93, AD92, AJSV13, AJV14], Also, see [LB04, HQKL10, ZXZ12, LP11, Vull3, 
SS13, HN14], But the literature so far has focused on the theory of kernel functions 
defined on continuous domains, either domains in Euclidean space, or complex domains 
in one or more variables. For these cases, the Dirac S x distributions do not have finite 
Jff- norm. But for RKHSs over discrete point distributions, it is reasonable to expect 
that the Dirac 5 X functions will in fact have finite Jf?- norm. 

An illustration from neural networks: An Extreme Learning Machine (ELM) is a 
neural network configuration in which a hidden layer of weights are randomly sampled 
(see e.g., [RW06]), and the object is then to determine analytically resulting output 
layer weights. Hence ELM may be thought of as an approximation to a network with 
infinite number of hidden units. 

Here we consider the discrete case, i.e., RKHSs of functions defined on a prescribed 
countable infinite discrete set V. We are concerned with a characterization of those 
RKHSs J4? which contain the Dirac masses S x for all points x £ V. Of the examples 
and applications where this question plays an important role, we emphasize three: (i) 
discrete Brownian motion-Hilbert spaces, i.e., discrete versions of the Cameron-Martin 
Hilbert space; (ii) energy-Hilbert spaces corresponding to graph-Laplacians; and finally 
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(iii) RKHSs generated by binomial coefficients. We show that the point-masses have 
finite -norm in cases (i) and (ii), but not in case (iii). 


Our setting is a given positive definite function k on V x V. where V is discrete (see 


above). We study the corresponding RKHS Jf? (= ^ ( k )) in detail. Our main results 
are Theorems 2.12, 3.18, and 4.13 which give explicit answers to the question of which 
point-masses from V are in Jf?. Applications include Corollaries 3.5, 3.20, 4.5, 4.7, 
4.11, and 4.12. 

The paper is organized as follows: Section 2 leads up to our characterization (The¬ 
orem 2.12) of point-masses which have finite ,'Zt 1 -norm. It is applied in sections 3 and 
4 to a variety of classes of discrete RKHSs. Section 3 deals with samples from Brow¬ 
nian motion, and from the Brownian bridge process, and binomial kernels, and with 
kernels on sets V x V which arise as restrictions to sample-points. Section 4 covers 
the case of infinite network of resistors. By this we mean an infinite graph with as¬ 
signed resistors on its edges. In this family of examples, the associated RKHSs vary 
with the assignment of resistors on the edges in G, and are computed explicitly from 
a resulting energy form. Our result Corollary 4.5 states that, for the network models, 
all point-masses have finite energy. Furthermore, we compute the value, and we study 
V as a metric space w.r.t. the corresponding resistance metric. These results, in turn, 
have direct implications (Corollaries 4.7, 4.11 and 4.15) for the family of Gaussian free 
fields associated with our infinite network models. 

A positive definite kernel k is said to be universal [CMPY08] if, every continuous 
function, on a compact subset of the input space, can be uniformly approximated by 
sections of the kernel, i.e., by continuous functions in the RKHS. In Theorem 4.13 
we show that for the RKHSs from kernels k c in electrical network G of resistors, this 
universality holds. The metric in this case is the resistance metric on the vertices of 
G, determined by the assignment of a conductance function c on the edges in G. 


2. Discrete RKHSs 


Definition 2.1. Let V be a countable and infinite set, and & (V) the set of all finite 
subsets of V. A function k : V x V —> C is said to be positive definite, if 



( 2 . 1 ) 


(x,y)eFxF 

holds for all coefficients { c x } X £f C C, and all F E & (V). 


Definition 2.2. Fix a set V, countable infinite. 
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(1) For all x G V, set 

k x := k (•, x) : V — > C (2-2) 

as a function on 1/. 

(2) Let JF := Ji? (k) be the Hilbert-completion of the span{k x : x G V}, with 
respect to the inner product 

^ 'y ' c x k x , ^ ^ dyky^j .— ^ ^ ^ ' c x dyk (x,y) (2.3) 

modulo the subspace of functions of zero ^-norm. J'F is then a reproducing 
kernel Hilbert space (HKRS), with the reproducing property: 

( k x , = p (x) , Vx G V, \/ip G JF. (2.4) 

Note. The summations in (2.3) are all finite. Starting with finitely supported 
summations in (2.3), the RKHS M 1 = J4? (k) is then obtained by Hilbert 
space completion. We use physicists’ convention, so that the inner product 
is conjugate linear in the first variable, and linear in the second variable. 

(3) If F G & (V), set = closed spanj/c^l^gp C Jff, (closed is automatic if F 
is finite.) And set 

Pp := the orthogonal projection onto J^f- (2-5) 

(4) For (V), set 

K f := (k(x,y)) {x y)&FxF (2.6) 

as a x j^F matrix. 


Remark 2.3. It follows from the above that reproducing kernel Hilbert spaces (RKHS) 
arise from a given positive definite kernel k, a corresponding pre-Hilbert form; and then 
a Hilbert-completion. The question arises: “What are the functions in the completion?” 
Now, before completion, the functions are as specified in Definition 2.2, but the Hilbert 
space completions are subtle; they are classical Hilbert spaces of functions, not always 
transparent from the naked kernel k itself. Examples of classical RKHSs: Hardy spaces 
or Bergman spaces (for complex domains), Sobolev spaces and Dirichlet spaces (for real 
domains, or for fractals [OST13, ST12, StrlO] ), band-limited L 2 functions (from signal 
analysis), and Cameron-Martin Hilbert spaces from Gaussian processes (in continuous 
time domain). 
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Our focus here is on discrete analogues of the classical RKHSs from real or complex 
analysis. These discrete RKHSs in turn are dictated by applications, and their features 
are quite different from those of their continuous counter parts. 


Definition 2.4. The RKHS LTP = Jf? (k) is said to have the discrete mass property 

f 1 if x = y 

(Jif is called a discrete RKHS), if 5 X G for all x 6 V. Here, 5 X ( y ) = < 

I 0 if x yi y 

i.e., the Dirac mass at x G V. 

Lemma 2.5. Let FgI' (K), x\ G F . Assume 6 Xl G J'F. Then 

Pf {S Xl ) (•) = £ {K^S X1 ) (y) k y (•). (2.7) 

y&F 

Proof. Show that 

5 X - £ {Kp l 6 xi ) (y) k y (•) G (2.8) 

y£F 

The remaining part follows easily from this. 

(The notation (Jtfp) 1 ' stands for orthogonal complement, also denoted Jt? © Jtfp = 

{<pe (/, ¥ >) jr = 0, V/g^}.) □ 


Lemma 2.6. Using Dirac’s bra-ket, and ket-bra notation (for rank-one operators), the 
orthogonal projection onto J4 ?f Is 


= £ \ k v)(K \; 

y£F 

where 

K ■■= £ 

y&F 

is the dual vector to k x , for all x G V. 

Proof. Let k* be specified as in (2.10), then 

{k* x ,k z )^> = ^({Kp^yxky,^ 

y&F 

= £ {P-F^xy fty, k z )j{? 

y&F 

= £ (^F^xy ( Kp )yz = ^,z, 

yeF 

i.e., fe* is the dual vector to k x , for all iGb 


(2.9) 


( 2 . 10 ) 
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For / E and Fg# (V), we have 

= E Kf).r k > 

y&F y&F 

= EE 

(■ y,z)£FxF 

= P F f. 

This yields the orthogonal projection realized as stated in (2.9). 
Now, applying (2.9) to S X1 , we get 

P F (S X1 ) = J2K 6 *i)jr k y 

2/6F 

= E (X3 (^F )yz( kz, ^ x l)^j k y 

y£F VzSF ) 


where 


This verifies (2.7). 


E E ( K k),j« w *» 

J/SF VzGF / 

XZ (^F ^*1) (y)kyi 

2/SF 


(^40(2/) -E^A*^ (*)■ 

zSF 


□ 


Remark 2.7. Note a slight abuse of notations: We make formally sense of the expres¬ 
sions for Pf(S x ) in (2.7) even in the case when 6 X might not be in J#?. For all finite 
F. we showed that Pf(S x ) E J4?. But for 5 X be in we must have the additional 
boundedness assumption (2.18) satisfied; see Theorem 2.12. 

Lemma 2.8. Let Fe^ (V), x\ E F , then 

(Rp &xi) ( x i) = \\PfS X i \\^- 

Proof. Setting := Kf 1 (<J X1 ), we have 

Pf(S x1 ) = Y^C {F) (y)k F (;y) 

y^F 


( 2 . 11 ) 
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and for all z £ F, 

Y c (F) (*) pf (s xi )(z) = YY t {F) ^ ( {F) (y) kp ( z ’ y) 


( 2 . 12 ) 


zeF 


F F 


£(*'') (xi) 


— II-Pf^xi II jff ■ 

Note the LHS of (2.12) is given by (see Lemma 2.6) 

\\Pf 5 x1 \\ 2 ^ = {Pf^x i j )jr 

= Y1(^f ^i) (u) (kyi 

y&F 

= (A'/^j) (xi) = Kp 1 (xi, xi). 

Corollary 2.9. If 5 Xl G ("see Theorem 2.12), then 

sup (K p S X1 ) (si) — 11 8 X 1 11* 

FejF(v) 

The following condition is satisfied in some examples, but not all: 
Corollary 2.10. 3F e & (V) s.f. 5 X1 € J%f 

A^, 1 (S X1 ) (xi) = Kp 1 (S X1 ) (xi) 

for all F 1 D F. 

Corollary 2.11 (Monotonicity). If F and F’ are in 3? (V) and F C F’, then 


□ 


(2.13) 


and 


{Kp X 8 Xl ) (si) < (Kp}5 Xl ) (xi) 


ji™, {K p 1 5 x J (xi) = \\5 Xl \\%. 


(2.14) 

(2.15) 


Proof By (2.11), 

(Kp 5 a , 1 ) (Xl) = \\Pf 5 Xi \\jjf • 

Since J%f C J%f', we have PfPf 1 = Pf, so 

II^F«U3f = ll-PF^F'^ill^r < \\Pf' 5 x1 \\%> 

i.e., 

(xi) < (K~}8 Xl ) (xi). 




So (2.14) follows; and the limit in (2.15) is monotone. 


□ 


Theorem 2.12. Given V, k : V x V —> M positive definite (p.d.). Let 34? = 34? (k) 
be the corresponding RKHS. Assume V is countable and infinite. Then the following 
three conditions (i)-(iii) are equivalent; x\ £ V is fixed: 

(i) S X1 € 34*; 

(ii) 3C X1 < oo such that for all F £ 8F (V), the following estimate holds: 

|£(zi)| 2 < C X1 EE? (x)£(y)k(x,y) (2.16) 

FxF 

(in) For Fg# ( V ), set 

I\ F = (k (x, y)) {Xty)eFxF (2.17) 

as a ffF x ffF matrix. See Definition 2.2, eq. (2.6). Then 

sup ( Kfi}5 Xl ) (xi) < oo. (2.18) 

F£^(V) 


Proof. (i)=^(ii) For £ E l 2 (F), set 


y£F 


Then ( 6 Xl ,h%)^ = £ (xi) for all £. 
Since 8 X1 6 34?, then by Schwarz: 


| (8 Xl i hfi) jtf, 

| 2 < 114, 

; h 

y = xi 

®1 >2/ — S 

y^x i 

I 0 


(2.19) 


FxF 


But (5 Xl , ky ) Jg? 8 X i,y — 

(2.16). 

(ii) => (iii) Recall the matrix 


; hence (S X1 , h^ = £ (xi), and so (2.19) implies 


Kf ■— ({kx, ^y)){ x , y )e F xF 
as a linear operator l 2 (F) —y l 2 (F), where 

(k f <p) (x) = Y k f ( x > y) t (y ). <p e i 2 ( F ) ■ 

y£F 


( 2 . 20 ) 


By (2.16), we have 


ker (A(f) C {</? E l 2 (F) : </? (xi) = 0} . 


(2.21) 
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Figure 2.1. h F -.= P F (8 Xl ) 


Equivalently, 



ker (K F ) C 

(2.22) 

and so <5 Xl 

E ker ( Kp) ± = ran ( Kp ), and 3 E l 2 (F) s.t. 

F 



8x! =^2C {F) (y)k(-,y). 

(2.23) 


y eF 


= :hp 

Claim. P F (8 X] ) = h F , where P F = projection onto J&f] see (2.5) and Lemma 2.5. 
(See Fig 2.1.) 

Proof of the claim. We only need to prove that 8 X1 — h F E Jff © i.e., 


(8xi tiF j kz) — 0, Vz E F. 

But, by (2.23), 

lhs (2 .24) = <W v ) C (F) (y) = o. 

y&F 


(2.24) 


□ 


If F C F'. F,F' E ^ (V), then C and PfPf' = P F by easy facts for 

projections. Hence 

— \\Pf' 6 Xi \\%, Hf := Pf (8 Xl ) 


and 


Jim. \\8 X1 - h F \\jg, = 0. 


(iii)=^(i) Follows from Lemma 2.8 and Corollary 2.9. 
Corollary 2.13. The numbers ( y)) y£F (2.23) satisfies 

c (F) (*i) = ^ {F) (y) t {F) (*) 

(y,z)£FxF 


□ 


(2.25) 
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Proof. Multiply (2.23) by (Y) (z) and carry out the summation. □ 

Remark 2.14. To see that (2.23) is a solution to a linear algebra problem, with F = 
{a?i}” =1 , note that (2.23) 4=> 

k(xi,xi) k(x i,x 2 ) ■■■ k(x i,x n ) 

k(x 2 ,x i) k{x 2 ,x 2 ) ■■■ k(x 2 ,x n ) 

(2.26) 



’ C (F) (xi) ' 


Y 


C (F) (X2) 


0 


C (F) (x n _l) 


0 


. C (F) (x n ) . 


_ 0 _ 


_k(x n ,x i) k(x n ,x 2 ) ••• k(x n ,x n )_ 

We now resume the general case of k given and positive definite on V x V. 

Corollary 2.15. We have 


where 


and 


C (F) (x 1 ) = \\P f (5 Xi )W%, 


Pf(s x1 ) = J2 C (f) (y) k y (■) 

y&F 


= K- 1 {5 X1 ) : N:=#F. 

Proof. It follows from (2.26) that 

y, k (xi, Xj ) C (F) (xj) = 5i,i 
j 

and so multiplying by £( F ) (z), and summing over i, gives 

y y fc (®i, ®j) C (F) (®i) C (F) (*i) = C (F) (*i) • 

* 3 


Corollary 2.16. We have 

(i) 

p F (6 xl ) = c^( Xl )k xl + y c (F) ( 2 /)fc, 

yeF\{a-i} 

where (f solves (2.26), for all F £ Y (V); 


(2.27) 

(2.28) 

(2.29) 


□ 


(2.30) 


\\ p F (ti Xl )\\%> = C (F) (xi) 


(2.31) 









and so in particular: 
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(Hi) 


0 < C (F) (si)< 114,11^ 


Proof. Formula (2.31) follows from the definition of (as a solution to the 
problem IF/vC^ = 5 Xl , but we may also prove (2.31) directly from 

Pf( 5 x1 ) = '£( {f) ( y) k v 

y 

Apply {-,8 Xl )to both sides in (2.33), we get 

(S Xi ,Pf( 6 Xi ))^ = C {F) (*i) 

S -V-' 

\\M s *l)\\lr 


since 


Pp = Pf = Pp\ i.e., a projection in the RKHS M 1 = My of k. 


Example 2.17 (ffF = 2). Let F = {xi,X 2 }, Kp = (kij) t J=1 , where kij := k( 
Then (2.26) reads 


hi 

ki2 

C F (si) 


1 

k-n 

k‘22 

C F (X2) 


0 


Set D := det (Kp) = k\ \ k 2 2 — ^ 12 ^ 21 , then: 

(f(x i) = -Jj, Cf(s 2 ) = — 

Example 2.18. Let V = {xi, X 2 ,. ..} be an ordered set. Set F n := {xi,..., x n 
that with 

D n = det (K Fn ) = det {(k (x*, Xj))T =1 ^) , and 
D'n-i = (!> !) minor of Kp n = det ((fc (si,Xj))” J=2 ) ; 

then 


C (Fn) (si) = (si) • 




Corollary 2.19. We have 


1 


k(x i,xi) ^ D 2 ~ ~ D n 

Proof. Follows from (2.37), and if F C F' are two finite subsets, then 

(^i)lljr — ll^ill^ ■ 


(2.32) 
matrix 

(2.33) 

□ 

]Xi,Xj). 

(2.34) 

\. Note 

(2.35) 

(2.36) 

(2.37) 


□ 
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Let fc:LxL->lbeas specified above. Let JF = JF ( k ) be the RKHS. We set 
(U):= all finite subsets of V: and if x E V is fixed, (V) := {F E & ( V ) | x E F}. 
For (V), let Kp be the ffF x ffF matrix given by (k (x, y))r x y \ e p xF - Fol¬ 

lowing [KZ96], we say that k is strictly positive iff (Def.) det Kp > 0 for all F E JF ( V ). 

Set Dp := det Kp. If x E V, and F E JF X (V), set K' F := the minor in Kp obtained 
by omitting row x and column x. see Fig 2.2. 


x 


x 


x 


x 


Figure 2.2. The (x,x) minors, Kp —> K' p . 


Corollary 2.20. Suppose k : V x V —>■ M is strictly positive. Let x E V. Then 

D' 

6 X E JF sup —f - < oo. (2.38) 

Fe& x (V) d f 

2.1. Unbounded containment in RKHSs 

Definition 2.21. Let JF and JF be two Hilbert spaces. We say that JF is imboundedly 
contained in JF if there is a dense subspace JFq C JF such that JFq C JF\ and the 
inclusion operator, with JFq as its dense domain, is closed, i.e., 

JF c —>• JF, dom{incl ) = JFq. 

Let k : V X V —> M be a p.d. kernel, and let JF be the corresponding RKHS. Set 
JF = l 2 ( V ), and 

JF 0 = span{6 x \ x E V} . (2.39) 

Proposition 2.22. If 5 X E JF for \/x E V, then P ( V) is unboundedly contained in 
JF. 
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Proof. Recall that JP is the RKHS dehned for a fixed p.d. kernel k : V x V —> M. Let 
k x be the vector in JP, given by k x (y) = k (x , y ), s.t. 

f(x) = {k x ,f)je, VfeJP. (2.40) 

To finish the proof we will need: □ 

Lemma 2.23. The following equation 


(5 x , ky ) Jg: — $X,y (2-41) 

holds if 6 X G JP for \/x G V. 

Proof. (2.41) is immediate from (2.40). □ 

Lemma 2.24. On 

span{k x | x G V} C JP (2.42) 

define Mk x := 5 X , then by Lemma 2.23, M extends to be a well defined operator 
M : 2%? — y l 2 (V) with dense domain (2-42). We have 

(k, Mf) t 2(y) = (k, f)^ , Vk € span {4} , V/ G dom (M). (2.43) 

Proof. By linearity, it is enough to prove that 

(fixity) 1 2 = (2.44) 

holds for G V. But (2.44) follows immediate from Lemma 2.23. □ 


Corollary 2.25. If L : l 2 (V) —> denotes the inclusion mapping with dom (L) = 

span{5 x :iGf}, then we conclude that 


L C M*, and M C L*. 


(2.45) 


Since dom(M) is dense in Jf 1 , it follows that L* has dense domain; and that therefore 
L is closable. 


Remark 2.26. This also completes the proof of Proposition 2.22. 

Corollary 2.27. Suppose k : V x V —>• M is as given, and that = RKHS ( k ). Let 
L be the densely defined inclusion mapping l 2 (V) —> . Then L*L is selfadjoint with 

dense domain in l 2 (V ); and LL* is selfadjoint with dense domain in JP. Moreover, 
the following polar decomposition holds: 

L = U{L*L) 1/2 = {LL*) 1/2 U 

where U is a partial isometry l 2 (V) —> JP. 


(2.46) 
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3. Point-masses in concrete models 

Suppose V C D C where V is countable and discrete, but D is open. In this 
case, we get two kernels: k on D X D, and ky : = on V X V by restriction. If 

x € V, then k x (•) = k (•, x) is a function on V. while k x (•) = k (•, x) is a function on 
D. 

This means that the corresponding RKHSs are different, J4?y vs J0 0 , where = a 
RKHS of functions on V. and Jf = a RKHS of functions on D. 

Lemma 3.1. J^y is isometrically contained in via k^ i —> k x , iGV. 


Proof. If F C V is a finite subset, and £ = is a function on F. then 


'x£F 

The desired result follows from this. 


£ (x) k^ = ||V^ £ (x) fe 


xEF 




□ 


We are concerned with cases of kernels fc:hxD->l with restriction ky : V X V —> 
M, where V is a countable discrete subset of D. Typically, for x G V, we may have 
(restriction) 5 X \ V G =x£y, but 5 X ^ Jif', indeed this happens for the kernel k of standard 
Brownian motion: 

D = M_|_; 

V = an ordered subset 0 < x\ < X 2 < • • • < Xi < Xj+i < ■ ■ •, V = {xj}^. 

In this case, we compute J%y, and we show that 5 Xi \ v G while for = the 
Cameron-Martin Hilbert space, we have S Xi 

Also note that S X1 has a different meaning with reference to J^fy vs In the first 

{ 1 y = x i 

. In the second case, 6 X1 is a Schwartz 

0 yeV\{x i} 

distribution. We shall abuse notation, writing S x in both cases. 

In the following, we will consider restriction to V x V of a special continuous p.d. 
kernel k on M + X M + . It is k(s,t) = s At = min (s, t). Before we restrict, note that 
the RKHS of this k is the Cameron-Martin Hilbert space of function / on M + with 
distribution derivative f G L 2 (M + ), and 

/»oo 

Wf\\ 2 jF : = \f [t)\ 2 dt <oo. (3.1) 

Jo 

For details, see below. 

Application. The Hilbert space given by ||-||^ in (3.1) is called the Cameron- 
Martin Hilbert space, and, as noted, it is the RKHS of k : l + xR + —> M : k (s, t) := sAt. 
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Now pick a discrete subset V C M+; then Lemma 3.1 states that the RKHS of the Vx V 
restricted kernel, is isometrically embedded into Jtf, i.e., setting 

J (y) ( 'k^A = k x , Vx G V; (3.2) 

extends by “closed span” to an isometry J0y ——> jtf’. It further follows from the 
lemma, that the range of jV ) may have infinite co-dimension. 

Note that P v := J W ( J < y ))* is the projection onto the range of ,/V ). The ortho¬ 
complement is as follow: 

jt?eJ?v = {ipeJF\'ip(x) = o, \/xev}. (3.3) 


Example 3.2. Let k and kP v ' > be as in (3.2), and set V := vrZ+, i.e., integer multiples of 
7 r. Then easy generators of wavelet functions (see e.g., [BJ02]) yield non-zero functions 
ip on M+ such that 



ip G 0 'ffiy- 

(3.4) 

More precisely, 




0 < / | ^ (t)\ 2 dt < oo, 

./n 

(3.5) 

where i// is the distribution (weak) derivative; and 



ip (nir) = 0, Vn G Z + . 

(3.6) 

An explicit solution to (3.4)-(3.6) is 



tt- ( t \ sin t , , m 

^ (t) = n c ° s ( 2 „ j = t ’ vt ^ r - 

(3.7) 


n= 1 


From this, one easily generates an infinite-dimensional set of solutions. 

3.1. Brownian motion 

Consider the covariance function of standard Brownian motion Bf, t G [0,oo), i.e., 
a Gaussian process {Bt} with mean zero and covariance function 

E ( B s B t ) = s A t = min (s, t ). (3-8) 

We now show that the restriction of (3.8) to V xV for an ordered subset (we fix such 
a set V): 

V : 0 < x\ < X2 < ■ ■ ■ < Xi < Xi + 1 < • • ■ 
has the discrete mass property (Def. 2.4). 


(3.9) 




Set M/ = RKHS(k\ VxV ), 
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ky (xi, Xj ) = Xi A Xj. 

We consider the set F n = {xi,X 2 , ■ ■ ■, x n } of finite subsets of V, and 


K„ = k {Fn) = 


Xi 

Xl 

Xl ■ ■ 

• Xl 

Xl 

X 2 

x 2 ■ ■ 

■ X 2 

Xi 

X 2 

X3 ■ ■ 

■ x 3 

Xl 

X 2 

X’3 • • 

Xn, 


= (: Xi A Xj) n i j=l 


(3.10) 


(3.11) 


We will show that condition (iii) in Theorem 2.12 holds for ky. For this, we must 
compute all the determinants, D n = det (Kp) etc. (n = jfF), see Corollary 2.20. 


Lemma 3.3. 

D n = det (^(xi A Xj)?j = ^J = x\ {x 2 - x\) {x 3 - x 2 ) ■ ■ ■ (x n - x n -i) ■ (3.12) 

Proof. Induction. In fact, 


Xl 

Xl 

Xl ■ 

■ Xl 


Xl 

0 

0 

0 

Xl 

X 2 

x 2 ■ 

■ X 2 


0 

to 

1 

0 

0 

Xl 

X 2 

x 3 • 

• x 3 


0 

0 

x 3 - x 2 

0 

Xl 

X 2 

x 3 ■ 

%n_ 


_0 


0 

%n %n—l_ 


unitary equivalence in finite dimensions. □ 


Lemma 3.4. Let 

C(n) := K - 1 (6 X1 ) (•) 

be as in eq. (2.11), so that 


II p F n (4i)||^p = C(n) (^l) • 

Then, 

C(i,(i-i) = L 

C(n)(^i) = — 7 -v, forn = 2,3,..., 

xi (x 2 - xi) 


(3.13) 

(3.14) 


11 ^ 


112 

WJ'Cy 


X2 

X\ (x 2 -Xl)' 


and 











17 


Proof. A direct computation shows the (1,1) minor of the matrix K n 1 is 
D '„_, = det ((*, A *,&,„) = *2 (* 3 - ra ) (x a - x 3 ) • ■ ■ (x„ - x„-i) 


and so 


C(i) (®i) 
C(2) (*l) 

C(3) (*l) 
C(4) (®l) 


—, and 
X] 

X2 

Xl (x 2 ~ Xl) 

X2 (X 3 ~ X 2 ) _ X 2 

Xl (x 2 - Xl) (x 3 ~ X 2 ) Xl(x 2 -Xl) 

X2 (x 3 ~ X 2 ) (x 4 - X 3 ) _ X 2 

Xl (x 2 ~ X'l) (X 3 ~ X 2 ) (x 4 - X 3 ) Xl (X 2 - Xl) 


The result follows from this, and from Corollary 2.9. 


Corollary 3.5. Pp n (<5 Xl ) = Pf 2 (^xi)> Vn > 2. Therefore, 

5 X1 G J^y F ' 2) := spcm{kW,kW} 

and 


= C( 2 ) (®i) + C( 2 ) (x 2 ) k£p 


where 

Specifically, 


and 


C(2) i x i) — A 2 (4J (xi), i — I; 2. 


C(2) {xi) 
C(2) M 


X2 

Xl (x 2 - Xl) 
-1 

X2 — Xl ’ 


lie 112 _ X 2 

Xl ^ Xl (X2 — Xl) ’ 


Proof. Follows from the lemma. Note that 

C n (xi) = \\P Fn (<5x 1 )||^f> 

and C(i) (xi) < C( 2 )(xi) < •, since F n = {xi, x 2 ,..., x n }. 

xdxalx!) ’ which y ields ( 3 ' 2 °)- 


In particular, 


(3.15) 


□ 

(3.16) 

(3.17) 

(3.18) 

(3.19) 

(3.20) 

A < 

Xl — 

□ 
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Remark 3.6. We showed that S X1 E V = { x\ < < ■ ■ ■ } C M+, with the restric¬ 

tion of s A t = the covariance kernel of Brownian motion. 

The same argument also shows that 5 Xi E when i > 1. We only need to modify 
the index notation from the case of the proof for S Xl E My. The details are sketched 
below. 

Fix V = x\ < X 2 < ■ ■ ■ , then 


and 


Conclusion. 


P F n (S Xi ) = 


if n < i — 1 


E"=i i K Fn 6 xi) 0*) k x, i fn>i 


\\PF n (S Xi )\\% = 


•Ei — 1 

_ %i— 1 _ 

t (xi— Xi-l)(®i+l— Xi) 


if n < i — 1 
if n = i 
if n > i 


S Xi E 


span {C..C.C.}. “ d 


ii& 


•Ei+l %i —1 




(Xi - Xi- 1 ) (x i+1 - Xi)' 


(3.21) 

(3.22) 


Corollary 3.7. Let V C M+ be countable. If x a € V is an accumulation point (from 
V), then ||5a||^ = oo. 


Remark 3.8. This computation will be revisited in sect. 4, in a much wider context. 


Example 3.9. An illustration for 0 < x\ < X 2 < x 3 < x 4 : 

Pf(S X3 ) = ^C (F) G/)M-) 

y&F 

C (F) = K^S X3 . 


X\ X\ X\ X\ 


’C (F) (xi)' 


'O' 

X\ X2 X2 X2 


C (F) (X2) 


0 

Xl X 2 X 3 X 3 


C (F) (^3) 


1 

JX 1 X2 X 3 X 4 _ 


_C (F) (x 4 )_ 


0 


(K F (xi, Xj ))f j=1 


That is 
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and 


l*(F) _ xi (x 2 - xi) (x 4 - x 2 ) 

X\ (x 2 - Xi) (x 3 - X 2 ) (x 4 - X 3 ) 

= 114 


(x 3 - X 2 ) (x 4 - X 3 ) " 3:3 ^ ' 

Example 3.10 (Sparse sample-points). Let V = {xi} c *l 1 , where 

*(*-!) 


Xi = 


ieN. 


It follows that Xi+i — Xi = i, and so 

%i +1 


II* 


XiUjg’ 


2i- 1 


> 0. 


(x; - Xj_i) (x i+ i - Xi) i->oc 

Conclusion. ||5 Xj || yy - - > 0 if the set V = {xj}“ 1 C M+ is sparse. 

i —^00 

Now, some general facts: 

Lemma 3.11. Let k : V X V —> C be p.d., and let Jrf? be the corresponding RKHS. If 
xi 6 V, and if 5 Xl has a representation as follows: 

4 1 = £ C (I1) (y) ky , (3.23) 

y£V 

then 

l|fc,lli = C (l,) («)- (3-24) 

Proof. Substitute both sides of (3.23) into (4i> where denotes the inner 

product in Jrff. □ 

Application. Suppose V = U n F n . F n c F n +\. where each F n e IF (V), then if 
xi 6 we have 

Fp n (4i) = ( x i, K Fn y) l2 k y (3.25) 

yeF n 

and 

II Ff„ (4i)||jt = ( x i) kL Fn xi)^ = {^Fn 4i) ( x i) (3.26) 

and the expression | Pp n (4 X ) is monotone in n. i.e., 

\\Ff„ (4i )||F ||-Pf„ + i (4i)||^ < • • • < ||4i \\jt? 

with 

sup 11-PPn (4 1 )||j^ = lim ||P Fn (S Xl )\\% = ||4Jjr ■ 

nSN n ^°° 
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Question 3.12. Let k : M d xM d —> M be positive definite, and let V C M. d be a countable 
discrete subset, e.g., V = Z rf . When does k\ VxV have the discrete mass property? 

Examples of the affirmative, or not, will be discussed below. 


3.2. Discrete RKHS from restrictions 

Let D := [0, oo), and k : D x D —> M, with 

k(x,y) = x A y = min (x, y ). 

Restrict to V : = {0} U Z + C D, i.e., consider 

k(V) = k \vxV 

J4? (k): Cameron-Martin Hilbert space, consisting of functions / € L 2 (M) s.t. 

\f {x)\ 2 dx < oo, / (0) = 0. 

Jtfy := J'iL ( ky )• Note that 

/ G Jf 1 ( k v ) <S=^- ^ | f(n)-f(n + 1)| 2 < oo. 

n 

Lemma 3.13. We have 5 n = 2 k n — k n + \ — k n -\. 

Proof. Introduce the discrete Laplacian A, where 

(A/) (n) = 2/ (n) - / (n - 1) - / (n + 1), 

then A k n = 5 n , and 



(flk n k n +1 k n — 1, km) — (fin , kin ) 


□ 


Remark 3.14. The same argument as in the proof of the lemma shows ( mutatis mu¬ 
tandis) that any ordered discrete countable infinite subset V C [0, oo) yields 

:= (^Ivxv) 

as a RKHS which is discrete in that (Def. 2.4) if V = {xi}?fi 1 , Xi G M+, then S Xi G J&v, 
Vi G N. 

Proof. Fix vertices V = , 


0 < X\ < X2 < ■ ■ ■ < Xi < Xi- 1_1 < OO, Xi —>• oo. 


(3.27) 



21 


Assign conductance 


Ci,i +1 — Ci+l,i — 


1 


®i+l -Ei 


1 

dist 


(3.28) 


Let 


(A/) (xj) = ( - 1 -1- 1 - ) / (xi) 

\X i+ l-Xi Xi-Xi-l/ 


1 


%i %i —1 


-f{Xi- 1) - 


1 


3^+1 


-/(Zj+l) 


(3.29) 


Equivalently, 

(A/) (x^ = (ci >i+ 1 + c^j—i) / (xj) - Ci,i_i/ (xj-i) - c M+ i/ (x i+ i). (3.30) 

Remark 3.15. The most general graph-Laplacians will be discussed in detail in sect. 4 
below. 


Then, with (3.30) we have: 

Afe^i — &Xi 

where &:(■,•) = restriction of s At from [0, oo) x [0, oo) to V x V; and therefore 

&Xi = (cj,i+1 T Ci,i— l) Cj,i— l/Cxi_i £ '^V' (3.31) 

as the RHS in the last equation is a finite sum. Note that now the RKHS is 

{ oo 

f - V -)• C I ^2 Cj,i+11/ ( x *+i) - / (^)l 2 < 00 

i=l 

□ 



3.3. The Brownian bridge 

Let D : = (0,1) = the open interval 0 < t < 1, and set 

^bridge (5, t) .— S A t .St, (3.32) 

then (3.32) is the covariance function for the Brownian bridge ( t ), i.e., 


( 0 ) = Bbri ( 1 ) = 0 


(3.33) 
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FIGURE 3.1. Brownian bridge B br i{t), a simulation of three sample 
paths of the Brownian bridge. 


B bri (t) = (1 -t)B 


1 - t 


, 0 < t < 1; 


where B (t) is Brownian motion; see Lemma 3.1. 
The corresponding Cameron-Martin space is now 


Mbri = {/ on [0, 1]; /' € L 2 (0,1), / (0) = / (1) = 0} 


with 


2 

yOF . - 

i7cbri 


| f (s)| 2 ds < oo. 


(3.34) 


(3.35) 


(3.36) 


If V = {xi}°^ 1 , x\ < X 2 < ■ ■ ■ < 1, is the discrete subset of D , then we have for 
F n € & (V), F n = {xi,X2, ■■■ , x n }, 


see (3.32), and 


Ff u — (kbridge (.Xii 7 = 1 


det K Fn = Xi (x 2 - Xi) ■ ■ ■ (x n - x n -i) (1 - x n ) 

( bri ) 


(3.37) 

(3.38) 


As a result, we get S Xi € Jtfy ' for all i. and 


II4J 

Note lim^^i \\S Xi \\ 2 ^ bri) = oo 


(Zj+l - Xi) (Xi - Xi- 1)' 


^2+1 ^2 — 1 
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3.4. Binomial RKHS 


Definition 3.16. Let V = U {0}; and 

xAy 


h (x,y) := Y 


n =0 


x\ y 


n / \n 


, (x, y) G V x V. 


x\ _ x(x-l)---(x—n+l) 


where (“) = 
mial expansion. 

Let = JFF (kb) be the corresponding RKHS. Set 


denotes the standard binomial coefficient from the bino- 


e n ( x ) = 


(n) if n < * 

0 if n > x. 


(3.39) 


Lemma 3.17 (see [A J15] ). 

(i) e n (•) € JP, n G V; 

(ii) {e n } n£V is an orthonormal basis (ONB) in the Hilbert space 
(Hi) Set F n = {0,1,2,..., n}, and 


or eqidvalently 


P F n = Y \ e k)( e k\ 

k =0 


P F n f = Y ( e kif)jF e k 

k =0 


(3.40) 


(3.41) 


then, 


(iv) Formula (3. 41) is well defined for all functions f : V —> C, f G &unc(V ). 

(v) Given f G &unc(V); then 


fe jr^^|(e fc ,/)^| 2 < 


oo; 


(3.42) 


k =0 


and, in this case, 


2 

jt? 


Y K e ^’/) 


2 

je\ ■ 


k =0 


Fix x\ G V, then we shall apply Lemma 3.17 to the function f± = S X1 (in unc (V)), 
1 if y = xi 
0 if yfi xi. 


h ( V ) = 
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Theorem 3.18. We have 

n / u \ 2 

lifts, (i„)|l3r = E L) • 

The proof of the theorem will be subdivided in steps; see below. 

Lemma 3.19 (see [A J15] ). 

(i) For Vm, n E V, siLch that m < n, we have 


<W = £ (-I) m+i 

j=m 




(3.43) 


(ii) For all n E Z + , f/ie inverse of the following lower triangle matrix is this: With 
(see Fig 3.2) 

L (n) = {© 

0 if x < y 


xy 


(3.44) 


we have: 


{iP 


A-'h- 1 )*-"© ifV<*< 


n 


xy 


if x <y. 


(3.45) 


Notation: The numbers in (3.4-5) are the entries of the matrix (L^) 
Proof. We refer to [AJ15]. In rough outline, (ii) follows from (i). 


-l 


□ 


TOO 0 

110 0 

12 1 0 

13 3 1 


L (n) 



1 


1 


© ©y 
© ©y 


0 • • • 0 O' 

0 •••00 


10 : : 

* 1 - - : : 
0 : 
1 0 

. n 1 


FIGURE 3.2. The matrix L n is simply a truncated Pascal triangle, ar¬ 
ranged to fit into a lower triangular matrix. 
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Corollary 3.20. Let kb, , and n E Z+ be as above with the lower triangle matrix 
Lfi‘ Set 

K n (x, y ) = k b (, x, y) , {x, y) E F n x F n , (3.46) 

i.e., an (n + 1) x (n + 1) matrix. 

(i) Then K n is invertible with 

K- 1 = (L^y 1 (K)- 1 ■ (3.47) 


an (upper triangle) X (lower triangle ) factorization. 

(ii) For the diagonal entries in the (n + 1) X (n + 1) matrix if” 1 , we have: 

2 


and therefore, 


Conclusion. Since 
for all xi E F n , we get 

ll^„(4 1 )||^ 


(x,K n x) p 'y ' 

k=x 

\\ p F n (S X1 )\\%> = {x t ,K~ l xi) 


(3.48) 


= E 

k=x i 

= i + 


n 


.Tl 


xi + l\ /xi + 2^ 

xi / V 


+-h 


(3.49) 


11$ 


W = E 


°o 


Xi 


= oo. 


in ot/ier words, no 5 X is in Jif. 


4. Infinite network of resistors 

Here we introduce a family of positive definite kernels k : V x V —> M, defined 
on infinite sets V of vertices for a given graph G = (V, E ) with edges E C V X 
V\ (diagonal). 

There is a large literature dealing with analysis on infinite graphs; see e.g., [JP10, 
JP11, JP 13] ; see also [OS05, BCF+07, CJ11], 

Our main purpose here is to point out that every assignment of resistors on the 
edges E in G yields a p.d. kernel k, and an associated RKHS J4? = J4? ( k ) such that 


6 X E Jff, for all x E V. 


(4.1) 
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Definition 4.1. Let G = (V, E) be as above. Assume 

1. {x,y ) E £ (y,x) E E- 

2. 3c : E —> M_(_ (a conductance function — 1 / resistance) such that 

(0 xy ) yx)i ^ (%ll) ^ ^‘ 

(ii) for all x E V, # {y E V | C( Ty ) > 0} < oo; and 

(iii) 3o E V s.t. for Vx E R\{o}, 3 edges (xj,Xj + i)q _ 1 E 13 s.t. x Q = 0, and 
x n = x: called connectedness. 

Given G = (V, E), and a fixed conductance function c : E —> M + as specified above, 
we now define a corresponding Laplace operator A = A^ c ) acting on functions on V, 
i.e., on &unciy ) by 

(A/)(x) = 5^c X! ,(/(x)-/(y)). (4.2) 

y~x 

Let be the Hilbert space defined as follows: A function / on V is in JtfP iff 
/ (o) = 0, and 

II/lljT := \^2^2°xy\f (x) -f(y )| 2 < oo. (4.3) 

( x,y)eE 
CVxV 

Lemma 4.2 ([JP10]). For all x E R\{o}, 3v x E J4? s.t. 

f(x)-f(o) = {v x ,f) je , V/E^ (4.4) 

where 

{h, f)jg> = \Y J2 Cx v { h ^ ~ h U ( x ) “ / (y)) > V/i,/EJT. (4.5) 

{x,y)eE 

(The system {v x } is called a system of dipoles. ) 

Proof. Let x E V\ {o}, and use (4.2) together with the Schwarz-inequality to show 
that 

i fix) - f{o) i 2 < y j— —i/(®o - /(^+i)| 2 - 

C-XiXi _i_ i 
z * Z 

An application of Riesz’ lemma then yields the desired conclusion. 

(c) 

Note that v x = v x depends on the choice of base point o E V, and on conductance 
function c; see (i)-(ii) and (4.3). □ 

Now set 

k (c) (x, y ) = (v x , v y )^ , V (xy) E (V\ {o}) x (V\ {o}). (4.6) 
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It follows from a theorem that k ^ is a Green’s function for the Laplacian Ain the 
sense that 

AMk® (x, •) = S x (4.7) 

where the dot in (4.7) is the dummy-variable in the action. (Note that the solution to 
(4.7) is not unique.) 

Lemma 4.3 ([JP11]). Let G = (V,E), and conductance function c : E —>• M+ be a 
s specified above; then in (4-6) is positive definite, and the corresponding RKHS 
34? ( k (c) ) is the Hilbert space introduced in ( 4-3 ) and (4-5), called the energy-Hilbert 
space. 

Proof. See [JP10, JP11, JP13]. □ 

Proposition 4.4. Let x G P\{o}, and let c : E —>• M_(_ be specified as above. Let 
M 1 = 3?? ( k c ) be the corresponding RKHS. Then 5 X € 34?, and 

ll<y Iff = ^2 C (xy) =■ c i x ) ■ (4.8) 

y~x 

Proof. We study the finite matrices, defined for VP G & (P), by 

K f (x, y) = k c (x, y ), (x,y) G F x F. (4.9) 

Fix x G V\ {o}, and pick (V) such that 

{x} U {y G V | y ~ x} C F, (4-10) 

see Fig 4.1; an interior point: 



Figure 4.1. Neighborhood of x, see Def. 4.1 (ii). An interior point x. 
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Let F E & (V) be as in (4.9) and in Fig 4.1, and let A = be the Laplace 
operator (4.2), then for all (x,y) E F X F, we have: 

{x,K f y)j2 = 

= (A 5y) (x) 

c(x) if y = x; see (4.8) 

-C( XJ/ ) if y ~ x (4.11) 

0 for all other values of y 


In particular, 


and in fact, 


= 


sup ( K f 5 x ) (x) < oo; 

Fe&(v) 


\\8x\\%> = c(x) , for all x E C\{o}, 


as claimed in the Proposition. 

The last step in the present proof uses the equivalence (i)l=>(ii)<t4>(iii) from Theorem 
2.12 above. 

Finally, we note that the assertion in (4.11) follows from 


A v x = S x -S 0 , Vx E V\ {o} . (4.12) 

And (4.12) in turn follows from (4.4), (4.2) and a straightforward computation. □ 

Corollary 4.5. Let G = (V,E) and conductance c : E —>• M + be as specified above. 
Let A = A( c ) be the corresponding Laplace operator. Let = J'F ( k c ) be the RKHS. 
Then 

(<W)jr = ( A f)(x) (4.13) 

and 

5 x = c (x) v x - y, C Xy Vy (4.14) 

yr^x 

holds for all x E V. 


Proof. Since the system {u x } of dipoles (see (4.4)) span a dense subspace in JF, it is 
enough to verify (4.13) when f = v y for y E V\ {o}. But in this case, (4.13) follows 
from (4.7) and (4.11). □ 

Corollary 4.6. Let G = ( V,E ), and conductance c : E —» R + be as before; let 
A^ c ) be the Laplace operator, and the energy-Hilbert space in Definition f.l (see 

(4-3)). Let k(x, y) = (v x , v y) be the kernel from (4-6), i.e., the Green’s function 
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of A( c ). Then the two Hilbert spaces J4 ?e, an d (fc( c )) = RKHS (fc( c )), are naturally 
isometrically isomorphic via v x i —> kfff* where kIf* = k^ (x, •) for all x € V. 


Proof. Let (V), and let £ be a function on A: then 


^ k * ] 


jr(fc( c 


EEfi ®)£ (y) fc (c) (x,y) 


FxF 


( 4 . 6 ) 


5^5^ (x)£ (y) ( v x , 




FxF 




2 

Jce 


The remaining steps in the proof of the Corollary now follows from the standard 
completion from dense subspaces in the respective two Hilbert spaces 3^e and 3%* (&( c )). 

□ 


In the following we show how the kernels k^ :LxL->K from (4.6) in Lemma 4.2 
are related to metrics on V; so called resistance metrics (see, e.g., [ JP 10, AJSV13].) 

Corollary 4.7. Let G = (V,E), and conductance c : E —X M_|_ be as above; and let 
k^ (x,y) := (v x ,v y ) be the corresponding Green’s function for the graph Laplacian 
A( c ). 

Then there is a metric R (= R^ c ' = the resistance metric ), such that 
ki c) (x y) = R {c) ( o,x) + R ( c ) (o, y) - fi( c ) (x, y) 

holds on V X V. Here the base-point o G V is chosen and fixed s.t. 

(V x , f)^ E = / (x) - / (o) , V/ G JPe, Vx € V. 

Proof. See [JP10]. Set 

R {c] (x,y) = \\v x - v y \\^ . 

We proved in [JP10] that R^ (x,y) in (4.17) indeed defines a metric on V ; the so 
called resistance metric. It represents the voltage-drop from x to y when 1 Amp is fed 
into (G, c) at the point x, and then extracted at y. 

The verification of (4.15) is now an easy computation, as follows: 

R (c) (o, x) + R ( c ) (o, y ) - i? (c) (x, y) 

2 

IIWII^, -I- mijsfe \\ V X v y\\j^ E 


(4.15) 

(4.16) 

(4.17) 


2 
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— { V XlVy)jfP E 

= (x,y) by (4.6). 

□ 

Proposition 4.8. In the two cases: (i) B (t), Brownian motion on 0 < t < oo; and 
(ii) the Brownian bridge Bb r i (t), 0 < t < 1, from sect. 3, the corresponding resistance 
metric R is as follows: 

(i) IfV = {xj}“ x C (0, oo), x\ < X 2 < ■ ■ ■, then 

R^\xi,Xj) = \xi~Xj\. ( 4 . 18 ) 

(ii) IfW = {xj}“ 1 C (0, 1), 0 < x\ < X 2 < ■ ■ ■ < 1, then 

R bridge (**> x j) = \ x i - x j\ • I 1 - \ x i ~ x j \) ■ ( 4 ' 19 ) 

In the completion w.r.t. the resistance metric R^\ ge , the two endpoints x = 0 
and x = 1 are identified; see also Fig 3.1. 

4.1. Gaussian Processes 

Definition 4.9. A Gaussian realization of an infinite graph-network G = (V,E), with 
prescribed conductance function c : E — > M+, and dipoles (^)xeV r \{o}’ a Gaussian 
process (X x ) xGV on a probability space (fi, &,¥), where is a sample space; IF a 
sigma-algebra of events, and P a probability measure s.t., for VP E & (V), the random 
variables (X x ) x&F , are jointly Gaussian with 


E (X x ) = [ X x dF = 0 

Jn 

(4.20) 

and covariance 


E (X x X y ) = k& (x, y) = ; 

(4.21) 

i.e., the covariance matrix (E (X x X y )), y ; &FxF is 


Kp [x, y ) := k l ' c ' 1 (x, y) on F x F. 

(4.22) 

Lemma 4.10 ( [JP10] ). For all G = (V,E), and c : E —>• M_|_ ; 
realizations exist; they are called Gaussian free fields. 

as specified, Gaussian 


Corollary 4.11. Let G = (V,E), c : E —> M + be as above; and let ( X x ) xeV be an 
associated Gaussian free field. Then the point Dirac-masses (S x ) xGV have Gaussian 
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realizations 


S x — c (x) X x ^ ^ C X yXy , Vx G U. 


(4.23) 


y^x 


Corollary 4.12. Let G = (V,E), and c : E —> R_|_ be as above. Let {X x } x( - V be the 
corresponding Gaussian free field, i.e., with correlation 

E (X x X y ) = k^ (.x,y) = (vi c \vV] 


OUE 


(4.24) 


where the dipoles C J^e ar c computed w.r.t. a chosen (and fixed) based-point 

o G V, i.e., 

U c \f)^ =f(x)-f(o), V/G^xGU. (4.25) 

Finally, let R^ ( x , y ) be the corresponding resistance metric on V. Then 

E (X x X z ) + E ( X z X y ) < E ( X x X y ) + R® (o, z) (4.26) 

holds for all vertices x,y,z G V; see Fig f.2. 

Proof. Use Corollary 4.7, and (4.17). We have 

II v x ^yWjff — IIW w|| jjf F ||Fz ^yWjff i 

and (4.26) now follows from (4.21). □ 



Figure 4.2. Covariance vs resistance distance RFI (o, z) for three ver¬ 
tices x,y, z G V. 


4.2. Metric Completion 

The next theorem illustrates a connection between the universal property of a kernel 
in a RKHS Jf ?, on the one hand, and the distribution of the Dirac point-masses 5 X , on 
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the other. We make “distribution” precise by the quantity E ( x ) := ||<5 X ||^>, the energy 
of the point-mass at the vertex point x. We introduce a metric completion M, and the 
universal property of the RKHS Jff asserts that the functions from are continuous 
and 1/2-Lipschitz on M, and that they approximate every continuous function on M 
in the uniform norm. Recall, the vertex set V is equipped with its resistance metric. 
The universal property here refers to the corresponding metric completion M of the 
discrete vertex set. In the interesting cases (see e.g., Example 4.14), M is a continuum; 
- in the case of the example below, the boundary of V is a Cantor set. One expects the 
value of E ( x ) to go to infinity as x approaches the boundary M, and this is illustrated 
in the example; with an explicit formula for E (x). 

Of special interest is the class of networks (V, E) where the resistance metric R (on 
the given vertex vertex-set V) is bounded; see (ii) in Theorem 4.13 below. This class of 
networks, for which the diameter of V measured in the resistance metric R is bounded, 
includes networks having lots of edges with resistors occurring in parallel; see e.g., 
[JP11], 

Theorem 4.13. Let G = (V, E ), c : E —> M+ be as above, and let R^ : V x V —> M_|_ 
be the resistance-metric (see (4-17)). Let M be the metric completion of (V,1T C '). 
Then: 

(i) For every f £ the function 

f3i^/(i)£ C (4.27) 

extends by closure to a uniformly continuous function f : M H > C. 

(ii) If R& is assumed bounded, then the RKHS J4L is an algebra under point-wise 
product: 

(/ 1 / 2 ) {x) = fi (x) f 2 (x ), fi £ i = 1, 2, x £ V. (4.28) 

(Hi) If M is compact, then {/ | / £ is dense in C (M) in the uniform norm. 

Proof. The assertions in (i) follow from the following two estimates: 

Let / £ J#?, then 

\f(x) ~ f(y)\ 2 < \\f\\lffR {c) (x,y), Vx,y£C; (4.29) 

and 

1/0*01 < l/(o)| +R (c) (o,x)5 . 

The estimates in (4.29)-(4.30), in turn, follow from Corollaries 4.6 and 4.7. 


(4.30) 
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To prove (ii), we compute the energy-norm of the product fi ■ fa where fi E Jff, 
i = 1, 2; and we use Corollary 4.6: 

Cx y l-fr “ A (y) /2 (y)l 2 

* 2/ 

= ^2^2 c xy K/ 1 ( x ) “ A (y)) /a 0) + /i (y) (/a (*) - /2 (y))| 2 

s 2/ 

< (lA ( x ) _ A (y)l 2 + 1/2 (®) - /2 (2/)| 2 ) • (1/2 (x)l 2 + l/i (y)| 2 ) 
s 2/ 

(by Schwarz inside) 

< (HAlL + IIAIiy-(llAll3r + IIAl3r)i 

and we note that the RHS is finite subject to the assumption in (ii). 

Proof of (iii): We are assuming here that M is compact , and we shall apply the 
Stone-Weierstrass theorem to the subalgebra 

{/|/E^} CC(M). (4.31) 

Indeed, the conditions for Stone-Weierstrass are satisfied: The functions on LHS in 
(4.31) form an algebra, by (ii), closed under complex conjugation; and it separates 
points in M by Corollary 4.7. □ 


Example 4.14 (The binary tree). Let A = {0,1}, and M := A the infinite 
Cartesian product, as a Cantor space. Set V := all finite words: 


V = U {(ai,«2, ■■■ ,oc n ) | on E {0,1}} ; (4.32) 

neN 

and set l ((cci, 02 , ■ ■ ■ , a n )) =: n. 

For u = (wfc)}° E M, set 

u\ n := {ui,u 2 , ■ ■ ■ ,u> n ) G V. (4.33) 

For two points ui,uj' E M, we shall need the number 

! (w (1 = sup {n : u;| n = u/| n }. (4.34) 

Let r : N — > M_|_ be given such that 

r (0) — 0, £ r (n) < 00 . (4.35) 

nG N 
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Figure 4.3. Edges in G 2 . 


For conductance function c : E 


set 


1 


a ^ at) r(l(a)) 

One checks that, when (4.35) holds, then 


, Va E V, t £ {0,1} . 


(4.36) 


lim (cul ,w| ) = 0. 

n,m—>• oo ' ' n ' rn ' 

Consider the graph G 2 = (V,E) where the edges are “lines” between a and (at), 
where t £ {0,1}. See Fig 4.3. 

Fact. With the settings above, the metric completion R( c l w.r.t. the resistance metric 
on V is as follows: For uj,u' £ M (see Fig 4-5), 

__ OO 

R( c ) (u, J)=2 r ( n ) • ( 4 - 37 ) 

n=l(ujP\oj') 

Let J4F be the corresponding energy-Hilbert space ~ the RKHS of k c . For a £ V, let 
5 a be the Dirac-mass at the vertex point a. Then 


11 11 jff 


2 1 

+ 


(4.38) 


r (l (a)) r (l (a) — 1) 

Proof. To see this, note that a has the three neighbors sketched in Fig 4.3, i.e., a*, 
(a0), and (ad), where a* is the one-truncated word, 

__ OO 

(cu, £*/) = 2 Y, r(n). (4.39) 

n=l(ojC\oj') 

One checks that when (4.35) is assumed, then the conditions in point (iii) of the 
theorem are satisfied. □ 


Corollary 4.15. Now return to the discrete restriction of Brownian motion in sect. 
3.1. Set V = {x\, x 2 , X 3 , ■ ■ ■ } where the points {xj}“ 1 are prescribed such that x\ < 
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(a) 



(b) 


Figure 4.4. Histogram for H^all^ as vertices a. G V approach the 
boundary. See (4.38), and note ||<5 a ||^ —> oo as a —> M. 



FIGURE 4.5. The binary tree and its boundary, the Cantor-set. 
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X 2 < ■ ■ ■ < Xi < Xj+i < • • •. We turn V into a weighted graph G as follows: The edges 
E in G are nearest neighbors; and we define a conductance function c : E -4 M + by 
setting 


c XiX i+1 — 


1 

Xi+1 Xi 


(4.40) 


and Laplace operator, 


(A/) (xi) = 


1 


Xi -\-1 X% 


(f(Xi) - f(x i+ 1 )) + 


Xi Xi —i 


(/ (Xi) - f (Xi-i)) . (4.41) 


Then the RKHS associated with the Green’s function of A in (4-41) agrees with that 
from the kernel construction in sect. 3.1, i.e., the discrete Cameron-Martin Hilbert 
space. 


Proof. Immediate from the previous Proposition and its corollaries. 


□ 
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